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OVERSHOOT FUNCTIONALS FOR ALMOST SEMI-CONTINUOUS 
PROCESSES DEFINED ON A MARKOV CHAIN 



Ievgen Karnaukh UDC 519.21 

In the article the distributions of overjump functionals for almost semi-continuous processes on a 
finite irreducible Markov chain are considered. 

The distribution of extrema and overjump functionals for the semi-continuous processes (processes 
that intersect positive or negative level continuously) on a Markov chain were considered by many 
authors ( for instance, see [1] - [3]). In the paper [4] the distribution of extrema for almost semi-continuous 
processes were treated (the processes that intersect positive or negative level by exponentially distributed 
jumps). Under some conditions these processes we can consider as surplus risk processes with stochastic 
premium function in a Markov environment. In the article the distribution of some overjump functionals 
for the almost semi-continuous processes defined on a Markov chain are considered. 

Consider a two-dimensional Markov process: 

Z(t) = {{(t),x(t)) *>0, 

where x(t) is a finite irreducible nonperiodic Markov chain with the set of states E = {1, . . . , m} and 
the matrix of transition probabilities 

P(t)=e tQ , t>0, Q = N(P-I), 

where N = ||5fc r i/fc||™ r=1 , are the parameters of exponentially distributed random variables (the 
sojourn time of x(t) in the state k), P = ||pfcr|| is the matrix of transition probabilities of the imbedded 
chain, tv = (jti, . . . ,ir m ) is the stationary distribution. is a process with stationary conditionally 
independent increments for fixed values of x(t) (see [1]). 

The evolution of the process Z(t) is described by the matrix characteristic function: 

* t (a) = \\E[e za ^ t+ ^-^\x(t + u)=r/x(u) = k]\\, u>0, 

which we can represent as follows 

* t (a) = Ee M «(*' = e**( Q ), *(0) = Q. 

In what follows, we consider processes that have cumulant 

9(a) = J (e iax -l)dK (x)+AF (0) (c (C + lal)" 1 - i) + Q, (1) 

where dK (x) = NdF(x) + H(dx), 

F(x) = \\P{ Xk r < z;z(Ci) = r/x(0) = k}\\, 
Xkr are the jumps of £(i) at the time of transition of x(t) from the state k to the state r. 

IL(dx) = AdFotx), F (a:) = \\6 kr F°(x)\\, 
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F®(x) are the distribution functions of the jumps of £(t) if x(t) = k, A = ||<5fcr^fc ||, arc the parameters 
of exponentially distributed random variables £l (the time interval between two neighboring jumps of 
if x(t) = k). C = ||<5fc r Cfc||, where Ck are the parameters of exponentially distributed positive jumps 
of if x(t) = k. The process Z(t) with this cumulant is the almost lower-semicontinuous process 
defined in [4, p. 43]. 

Let 9 S denote an exponentially distributed random variable with parameter s > (P{0 S > t} = 
e~ st ,t > 0), independent of Z(t). In this case, we rewrite the characteristic function of £,{9 S ) as follows 



/>oo 

*(«, a) = Ee ia «^) = s / e- st $ t {a)dt = s {si - *(a)) _1 
Jo 



(2) 



Denote the next functionals for 



e(t) = sup (inf)e(u), e = sup (inf)£(u), 

0<u<t 0<u<oo 

m = m-e(t), c(*) = r (*)-«*); (x>o) 

r+(x) = inf{f : > a:}, 7 + (x) = £(r+(x)) - x; 
7+(x) = a; - £(t+(x) ~ 0), 7+ = 7 + (x) + 7+(x). 

The distributions of £ ± (0 s ),t;(0 s ),£ (0 S ) were concretely defined in [4]. The aim of our article is 
to find joint moment generating function of overjump functionals for almost lower semi-continuous 
processes and the moment generating functions for pairs {t + (x), 7 + (x)}, {t + (x) , j + (x)}, {t + (.t), 7+}. 

Denote 

V(8,X,U,V,H) =E \ e -sT+(x)-wy+(x)-v~, + (x)-w+ ^ T + ^ < 1 > 
poo 

W(x, u, v,n)= / e {u - v)x - {u+ ^ z dK (z) 7 K (x) = W(x, 0, 0, 0), 

J X 

POO 

P s = s / e- st P(t)dt = s (si - Q)" 1 , 
Jo 

P + (s,x)=P{£+(0 s )<x},x>O;P-(s,x)=P{£(0 s )<x},x<O; 
P°( S ) = P{£(0 S )=O}, P ±( S )=P{e ± (^) = 0}, R- (,s)=P 5 T 1 P_ (a), 
P_ (s) = P {£ (0.) = 0} , q_ (s) = P s P_ (s), R c (s) =R (s)C, 

G+(s,a;,u,u,/i) = / dP~(s, y)W(x - y, u, u, /x). 

J — oo 

Lemma 1. For process Z(t) with cumulant (1) i/ie nearf relation holds 

sV(s,x,u,V,n)= j dP + (s,y)P^ 1 G + (s,x - y,u, u, /x), x > 0, 
Jo 

where for u — v a (Pj 1 P (s)CJ (spectrum of matrix) 



(3) 



G+(s, x, u, «, M ) = P- (s) / e^^-^^dKo^)- 



P (s)C (P; 1 P (s)C - (« - w)I 

-(p^P- (s)C+(» + v)l) 





/>0O - 








Jo 



(u + n)e-( u+tl >- 



p;'p-(s)c+(»+rii W 



P; 1 q (s)K Q {x + z)dz. (4) 
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Proof. Taking into account the condition of semi-continuity, formula (3) follows from [1, Corollary 3.4]. 
By results of [4] (see Remark 1) the distribution of £(0 S ) is determined by the relation 



P"(s,x) = e P- (s)cp ^- T q (s), x < 0, 



then 



f° 

G(s, x, u, v, fj) = / dP (s, y)~W(x — y, u, v, fi) = 

J — oo 

= P_ (s)W(x, u, v, n) 
+ P_ (s)C / e p > :lp - (s)c(l ^P i : 1 q (s)W(y,u,v,fi)dy. (5) 

J X 

Taking into account the definition of W(s, x, u, v, fi) we deduce 

/>OC 

/ e R*-«(*-!/)p-i q_ ( s )W(y,u,u,/i)dj/ = 

J X 

= - (p- 1 P_ (s)C - (« - ~ e"^^^ x 
(P; 1 P_ ( S )C + (fj, + v)l) J™ e -(p.- I i-Wc+H. p -i q (s) K o(a , + z)dz 

/* OO 

- (« + / e-^+^Pj 1 q ( S )K (i + z)d 
Jo 

and from (5) we obtain (4). 
Note, that 

lim P-(s, a:) = P \1{0 S ) < -co} = 0. 

X — > — oo 

Then from the next formula 
P- {s,x) = eP-WCPJ 1 * q_ ( s ) = pj> c:p PP i q ( s ) = p^M* (i_ R (< 



we get, that the spectrum of matrix R c (s) (a ^R c consists of strictly positive elements. 

Denote 

7i (x) = j + {x), 72 (x) = 7+(x), 73 (x) = 7+. 
Substituting u = fj, = 0, (it ^ <t(R c (s))), u = /i = and w = it = in (3) we find that 



E 



e -«r+(x)-U7 4 (x) )T +^ < 



I rf P+(s,?/)P s Gi(s,x-j/,u), % = 1,3; 
'o 



□ 



/>OC 

Gi(s,x,«) =P_ (s) y e u ^-^dK (z)- 



- P (s)C R c (a) -ul 



ue~ uz - R c (s)e- R <=( s ) 2 



P s 1 q_ (s)Kq(x + 



G 2 (s,x,v) =P_ (s)e- ra K (.x)+ P (s)Ce~ vx [ e { rM+vI J 2 p~i q ( s )K (x + z)dz; 

Jo 



G 3 (s,x,/z)=P- (s) / e-^dK {z) 



-fl.r 



- R c (s)+mI z 



P; 1 q {s)K {x + z)dz. 



After inverting with respect to u we deduce 



E 



e ST+{x) ,Ji(x) G dz,T + (x) < ooj = s 1 / rfP+(s, y) R (s)d 2 g*(s, x - y, z), 



where 



d zS *(s,x,z) = d z w*(x,z) + C f eR.«(*-v) (i_ r ( s )) d z w*(y,z)dy, 



d z Vf\{x,z) = d z K (x + z),d z W2(x,z) = d z I {z > x}K (x), 
d z w^(x, z) = I {z > x} rfKo(z). 
For the case x = the next assertion is true. 

Theorem 1. For process Z(t) with cumulant (1), if z > we have: 



E 



-«r+(o) j 7+(0) > Zj r + (0) < oo 

= s-'P^s) (k (z) + C I e (*-»)ncWpji q (s)Ko(y)^ 



E 



-ST+(0) 



7+(0) > z, r + (0) < ool = s _1 P°(s)C / e-wB-Wp- 1 q_ (s)K (j/)dy, 



E 



-ST+(0) ^ _ _+ 



7J" > z, r + (0) < oo 



= s^P^s) (k (z) + C y y e-^WdiuPr 1 q_ (s)dK (y)J . (6) 

Proof. From Eq. (3) it follows that 

V (s,x,u,v,fj.) = P + (s,x)P~ 1 + s^ 1 / dP + (s,y)Pj 1 G + (s,x - y,u,v,fj,), x > 0, (7) 

Jo 

where 

G_|_(s, x,u,v,jj,) = G+(s, x,u,v,fi) — G+(s, x, 0, 0, 0). 
Taking into account that for k = 1,3: 



V fc (s,x,u) = E [ e - 8T+ ^-" T)e ^,r + (x) < oo 



P+{s,x)p- 1 -u / e-" z E 
'o 



from (7) we obtain 



e~ uz E 



r+(x) , j k (x) > z, t+(x) < oo dz = — -I dP + (s,y)P s 1 G k (s,x -y,u), (8) 

J su J_ 



-ST~*~{x) 



, 7 fc (x) > z, t + (x) < oo 



where 



(9) 
(10) 



G k (s,x,u) =P_ (s)W k (x,u) + / (fl»-(«,y)W fc (x-y,u), 

«/ — OO 

Wi(x,«) = J°° - i) dK (z),W 2 (x, u) = (e- ux -l)K (x), 

W 3 (x,u)= / (e-" 2 -l)dKo(z). 



After the limit passage as x — > from (8) we get 



e" u *E 



-ST+(0) 



, 7fc (0) > z, r+(0) < oo dz = p + (s)P; 1 G fe ( S ,0, U ) 

J su 



(11) 



Substituting x — in (9) and using (10) we get 
Gi(a,0,tt)=-uP_ (*)( / e' uz K Q (z)dz+ 



G 2 (s,0,m) = -up_ (s)C 



e (^-y)R<=( S )p^i q ( s )K (y)dyd< 



G 3 (s, 0, u) = -n P_ (s) / e- uj: Ko(z)dz 



z JO 



e-'^^dxPj 1 q_ (s)dK (y)d; 



Substituting Gfe(s,0, it) in (11) and using the relation p + (s)P s x p (s) = P°(s)(scc [4, p. 47] with [4, 
Remark 1]), after inversion with respect to u we receive (6). □ 

Consider some corollaries of Theorem 1 and results of [2], namely, the analog of the inverted 
Pollaczeck-Khinchinc formula and two-sided Lundbcrg's inequality. Assume hereinafter that Xkr = 0, 
k,r — l,m. The almost semi-continuous processes that satisfy such conditions we can consider as 
surplus risk processes with stochastic premium function in a Markov environment. 

Let is the moment of the first jump of We have the next stochastic relations (see [1, p. 42]) 



Ckr ' u 



( k + (* r C k >Ck,x(Ck)=j; 



C' k <Ck, 



where indices kr means that a;(£*) = r, x(0) = k (k,r = l,m). Taking into account the definition of 
Z(t), these relations yield (see [1, p. 64]) 



Ee -<:, = E 



- s (',x(C)=r/x(0) = k 



E 



m 

e-< , C,' k < a] S kr +J2v [e- s Vr+C* i Ck > Cfe; x{a) 



p OO 771 POO 

/ X k e~ sy e- XkV e- VkV dyS kr + V / e -" a v k e-'"' v e- x '' v Ee- e G'-p kj dy 
Jo =1 Jo 



Afc (s + A fc + z/ fe ) 1 tf fer + ^ i/ fc (s + v k + A fc ) VfcjEe s ^<", 



or in a matrix form 



Whence 



Ee" sC * = A (si + A + N) -1 + (si + A + N) _1 NP Ee~ sC *. 



Ee~ sC * = (sl+ A - Qr 1 A. 
Taking into account that P°(s) = (I — Ee~ s< »*) P s , we get 



lim s- x P°(s) = (A - Qr 1 = ||P {x(C) = r/x(0) = k} ||A _1 . 

s— »0 
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Denote 

and assume that m\ < oo. 
Corollary 1. For mj < 



m r. 

? = / x\ k F%{dx). 

fc=l J « 



1 - ifc( u ) = P {£+ < u/i(0) = »} = P, {£+ < = G«» (I - ||G||) e, (12) 



n=0 



G + (u)= G + (dy)= P{ 7 +(0)edt/,T+(0)<oc} = 
Jo Jo 

-(A-Q)- 1 ^" (\F (dy) + C J° e^^ Cx (l-p-(0))AF o (dy-x)dxy (13) 

G+™(it) - n - fold convolution o/G+(u) iwii/i itself, ||G|| = J °° G+(dr), e = (1, . . . , 1)' (column vector), 
0, . . . , 1, . . . , ] (row vector). 



Proof. Formula (12) were obtained in [2] (see the proof of Proposition 2.2) for the processes, that in- 
tersect negative level continuously. However, the proof is also true for the processes for which pair 
{t + (0), 7 + (0)} has nondegenerate distribution. Since Z(t) is the stepwise process, then formula (12) 
holds for our process. Formula (13) follows from the first formula in (6). □ 

Let k(r) be the real eigenvalue with maximal absolute value (Perron's root) of the matrix K(r) = 
\&(— ir). Suppose that a solution 7 > of the equation k(r) = exists and v = (y\, . . . , v m ), h = 
[h\, . . . , h m ) are corresponding left and right eigenvectors of the matrix K( 7 ). We assume that vectors 
is, h have strictly positive elements and vh = l(sce [2, p. 42]). Denote 

1 F?{x) 1 F?(x) 

C+ = max — sup -y^ , , — tt. — r, C_ = min — inf 



jeE> hj x ^o /~ &<v-*)Ff(dy) ' " jeE' hj *>o /~ Ff (dy) ' 

Corollary 2. If < 0, then for all ieE' and all u > 

C-h ie -^ u < ipi(u) < C + h l e~' iU . (14) 
Proof. See the proof of Theorem 3.11 [2]. □ 



Q 



Example. Let Z(t) = {£(£), x(t)} be the process on a Markov chain x(t) with infinitesimal matrix: 
'-\ 1 
1 -\ J 

We assume, that \kr =0; k, r = 1,2, and component has the next representation: 
&(f) = Si(t) - Sl(t) = li - E & if x ® =*, < = 1,2, 

k<v' f {t) k<vt(t) 

where Si(t), S'^t) are compound Poisson processes with the rates A^,A^ = 1 and jumps r\ % k > 0, 
correspondingly. Moreover, 

P{a >*} =e~ c > x , -^P{4<x} = 6 i 2 xe- S * x , x>0, i = l,2; 
ci = -, c 2 = -, <5i = 2, <5 2 = 1. 
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Let's find the distribution of absolute maximum, which defines the ruin probabilities and the distribu- 
tions of overshoots for zero level. 

Consider auxiliary process Z\(t) = {£i(t),x(t)} = {— x(t)}, with cumulant 



*i(—ir) = 



9r J +34r J + 16r-4 
(3r-l)(r+2)^ 

1 



1 

6r 3 + 10r 2 ~l 
' (2r-l)(,r+l)\ 



In our case the stationary distribution is defined by n = (5,5), then = 1 > 0. Accordingly to [4, 
Theorem 3] has nondegenerate distribution. Consider the matrix 



G(r) := r^l x {-ir) (C - riy 1 



1 (gii{r) gi2 (r) 



D(r) VffaiW WO/ ' 



where D(r) = 48r 5 + 263r 4 + 387 r 3 + 114r 2 - 51 r - 8, g n (r) = 3(r + 2) 2 (6r 3 + 10r 2 - 1), g 12 (r) = 
2(r + l) 2 (r + 2) 2 (3r - 1), g 21 (r) = 3(r + l) 2 (r + 2) 2 (2r - 1), g 22 (r) = 2(r + l) 2 (9r 3 + 34r 2 + 16r - 4). 
Since equation D(r) = has four negative roots: 

-pi = -3.25672, -p2 = -1.59682, -p 3 = -0.794382, -p 4 = -0.133485 
and one positive = 0.30224, then the elements of matrix G(r) we can represent in the next form 



/n>2 /~f3 fi4 

G l3 {r) = C% + — 2- + — iL- + — 2- + ^ 



C> 



r + pi r + p2 r + p 3 r + p A r - r 
Use the projection operation (see [1, p. 34]), which for functions 



/oo 
e rx S (x)da 
-00 



is defined as follows 



then 



[G(r) 



e rx g(x)dx, 



Gr i (r) = [G ij (r)Y 



c 2 



r 3 



ri4 



Since 

R+ = (g-(0) + (A-Q)" 1 ) 
then according to [4, Theorem 3] 



r + pi r + p 2 r + p 3 r + pi 

1 /0.22 0.22^. 

0.17 0.17/ ' 



E; 



e r ^ , < = E e r ^ , Cr < 0/a?(0) = i 

A} 



E 



[G(r)]"R + -e = 



AS 



r + px r + p 2 r + p 3 r + p± 



i=l,2; 



where e = (1, 1)'. Inverting the last relation with respect to r, we can determine the distribution of £j 
as follows: ^ 

p, {cr < = p {cr < ^(o) = *} = E — ePfca; ' x < °- 



fc<4 



That is, we have the next representations of ruin probabilities 



^i(u) = Pi {e > u} = Pj {£■ < -u} « 

w -0.04 e - 3 - 26u + 0.001 e" 16 " + 0.079 e" 7911 + 0.75 e" 013 ", 
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= p 2 {e + > u} = p 2 {er < -«} « 

w -0.01 e - 3 26 « - 0.016 e" 1 - 6 " + 0.004 e" - 79 " + 0.85 e" 013 ". 
From other side, we can use inequalities (14): 

0.665e-° 13tl < ip^u) < 0.935e" 013 ", 
0.757e" 013tl < ip 2 (u) < 1.064e-°' 13 ". 

Moreover, form (6) as s — > we receive 

p r„ +(Q) > z T+(Q) <oo] ^ (e- 2 *(0A8 + 0.86z) e"*(0.31 + 0.22z) 
F( 7 (0)>z,r (U) <oo) ~l e -a, (0>21 + o.348) e - 2 (0.61 + 0.49z) 



P{ 7+ (0) >z,r+(0) <oo} 



0.1e- 2z (l + z) e _ *(0.2 + O.Lz) 
^0.09e- 22 (l + z) e- 2 (0.18 + 0.09z 

r 2 - 32 (0.0016 + 0.002z) -e _1 - 3z (0.02 + 0.013z) 
-e- 2 - 3 *(0.004 + 0.004z) e - 1 32 (0.05 + 0.03z) 

c " 2z (0.49 + 0.97z + 0.2z 2 ) e - z (0.3(l + z) + Q.lz 2 ) 
f{lo iUj<oo)«| „-2*( _2 + 0.4z + 0.18z 2 ) e" z (0.7(l + z) + 0.09z 2 ) 

e- 232 (0.005 + O.Olz) e- 13z (0.03 + 0.04z) 
s - 23z (0.01 + 0.03z) -e- 13z (0.075 + O.lz 
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